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and apparatus tor decoding 1 genera, codes on probata dependency graphs 



(54) 

(57) A block-parallel decoding algorithm and corre- 
sponding decoder architecture utilizes a set of intercon- 
nected processing nodes configured in the form of a 
probability dependency graph. The probability depend- 
ency graph is characterized at least in part by a code 
used to encode blocks of bits or symbols and the 
processing nodes implement a block-parallel decoding 
process for blocks of the bits or symbols to be decoded. 
The probability dependency graph may be, for example, 
a bipartite probability dependency graph which includes 
a set of N variable nodes and a set of T check nodes 
with one of the N variable nodes being associated with 
each of A/bits orsymbols of a given blockto be decoded. 
A single iteration of the block-parallel decoding process 



produces within the variable nodes an updated estimate 
for every bit or symbol in the given block, and may pro- 
duce within the variable nodes an a-posterion probabrt- 
ity associated with the decoded bit or symbol for a soft- 
decision decoder. As another example, the probability 
dependency graph may be in the form of a directional 
probability dependency graph with multiple levels of 
nodes including an initial level, at least one intermediate 
level and a final level, arranged such that calculations 
can be performed at each level without sequential irrtra- 
block dependencies. The outputs of the nodes of the fi- 
nal level give an estimate of the transmitted bits or sym- 
bols tor the given block, and may provide an estimate 
of the corresponding a-posteriori probabilities for a soft- 
decision decoder. 
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Background of the invention 

expanded state transition diagram caWattk f 1Q0 jnc|udes s branch metric 

[0 004] FIG. 1 shows a ^"^f^- 8 ^'^* I* 0 ^ AgLnoneoftheBMUsloa-ynasanlnputwhich 
unite (BMUs) 102, mdivfciually denoted 

LeivesabitorsymboUndanoutputwhiohiscouptedto^^^^ 
1(»v.TheBMU102VandACSU104iarea^ 



an outer loop wrnch iterates on ev».y — - ' bIock: 
[0006] For every received bit or symbol, fix* /= 0, 1 , ... N-i , in ine » 
30 For each state in the trellis: 
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sum of a previous state path metnc and tneassocmi Derf ormed in the ACSUs 104. 

rf „ mo(l nnee f or ever v bit or symbol in the received block of N 
[00071 As noted above, this iterative P roces V^°^ od ^a fteration which produces a single updated estimate 
bite or symbols to be decoded in order to "^"^J^^J^^ p«rt- architecture can be utilized 

of the received sequence for each bt or ^ J^J^Sle states as illustrated in FIG. 1 . However, 

bits or symbols of the received £ o me state that preceded it. This trace-back 

winning state, the decoding dec,s,on that .s t racea path defjned by tn 

process is continued until the state corres ponding 1 » * e J rt andis processed to yield the decoder output. 

decisionsidentifiesthemostBketytransmmedsequer^eo^ P pass across tne 

[0009] Unlike the Viterbi algorithm. *V2™*%^ 

trellis tofindthe maximum a-pos enon probata MyoT e ^J^SJ "Optimal decoding of linear codes for n» 

reference herein. cenuential processing, with operations being performed 
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■ r • of th« ACS oDeration above the bit or symbol rate and hence limits the speed at 
This dependency prevents pipel.nmg of the ACS operaton ^aoov, decoder 

which aconvotutlona. be <^^ «r parallel concatenation of two or more 

[0011] For applications requinng greater ^"^JJ,^^!, „ the so-called Turbo code described n ,e 
convolutional codes are often used. An examp e f a c °"^ n l ^7 errorHJorrecting coding: Turbo codes,' Proc. IEEE 
g. , C. Berrou, A. G.avieux. & P. ^S^^XJfl^ »V reference herein. The decoding 

Tnt. Conf Comm., Geneva Switzerland, 1993 pp. 1 ^^T™J n * for decodlng the next code trellis, and 

of concatenated codes requires the ^^^Z^m^^^^ 0 '^^^ 
so on forsubsequent code trellises. Such ^ 

sequentially through ^htmllfemu^lebrnes. ^^f^^^ necessitates a bit or symbol serial 
When implemented In hardware, the sequential nature £ number of it erati ons to be performed and 

architectureThis multiplies the latere of theWe^ 

the number of constituent codes, thereby resulting ton ""^"^j alg orithms also makes it impossible 
[0 012] As previously noted, the recursrve Mtlgh to Is possible to run the decoder at a 

o pipeline the calculations in order to ^V^^ni^eScyTuch an approach increases the power dls- 
hlgher clock speed In order to Imprnvethroughpui an^ 

-rnioi^rr^^ 

iterations performed. to , emulate a block-serial decoding process of a specific class of 

[0013] It is also known in the art that P^ b '^°~ g raphs . A compound code refers generally to a code 
codes, i.e., compound codes, us.ng P^^'^f^f n F ^ R 9 ^ hfecnan g & B . J. Frey. "Iterative decoding of com- 
resultJng from a combination of mu« pie c.des_S^^ 

pound codes by probability propagation ,n graph**! Howeveri such techniques have not heretofore 

2 pp 219-230, Feb. 1998, which is incorporated by re ' ere ^ | ™ c Trolutional codes, Turbo codes or other con- 
been applied to block-parallel decoding of genera, codes. ^^^SSSSk matrix can be determined, 
caten^ed codes, etc.. where a genera, code ^^XC^SSSXt*™ and corresponding decoder 

ELuTeS 
Summar y of the Invention 

and eliminates the serial dependencies ™* increasin 9 *««*P ut 

architectures described above, thereby su ^^^^^ goA ^ md corres P on6m^^^^ 
[0017] In accordance with the .nvenbon. a h^^JStotom. of a probability dependency graph. The prob- 
utilizeL a set of interconnected processmg node configured *efom,^ P y ^ o{ ^ ^ &ym 

ability dependency graph is charactered at leas he code us e o1 blt8 or symb ols to be decoded. 

and7he processing nodes implement a block-parallel ^ the « ^ ^ ^ 

[0018] '.n an Illustrative embodiment of the >™^^S^t5^?-cLk nodes, with one o, the N 
probability dependency graph wh,ch " ^ "™ J "J^ given block to be decoded. A single Iteration of 

variable nodes being associated with each of N bite o ^symbols of a gw ^ ^ ^ ^ symbol jn 

the block-paralle. decoding process ^produces '^^^^^^Z'^^^ M ^ mttM 
, he given block. Theblock-paralleldecod^ , ^ and ^ is a function 

s: sr-SL'^s; f «r^-'Si- — »* • — — or an approx,mate 
rxrro^^ 

.) of the input from the variable nodes connected tc MM ch a ^ check , uncti on. a hyperbolic 
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Star I maximum number of iteration^ ^-^^^^Josteriori probability or reliability, 
e.. decoded, transmitted bit or symbol and possibly >m ' """J "^bURy dependency graph Is In the form of a dl- 
[0022] in another Illustrative embodiment of ^^'^ZZ g Z inttia. level, at least one intermed-ate 
actional probability dependency ™^ ^^ n t pooled Meach level without sequential infra-bbck 
level and a final level, arranged such that f ^'^^"^^ each btt or symb ol in a given blockto be decoded, 
dependencies. The Initial level of nodes Includes an «^^*^,™ p JoT s teve i and defiver outputs only to 
Anodes in each intermediate level finaT level £l an estimate of the transmuted bHs or 

nodes of a subsequent level. The outputs of the nodes of Um fina mv g bodiment ^ pro viding as input 

sytboisfor^ 0 , ... Wl an d f <)is a 

to each node in the initial level afunct.on f (flxj) ^ e ^™'^", d r functlon a |, ne arscallng function, or an approximate 
unXn^inedatleastlnpartbythecode -^^^SS^^SL *.) of incoming values from the 
exponent function. W*^^^iES!S^ next .eve. of nodes, such that each of the .eve* 

codes. 

55 Brief Descrip "™ °* the Drawings 
[0024] 

S2?S JSSS. ot variable and crieck nodes, respective,, for use in a hard-decision decoder ,m- 

35 7^^:^ directions network probability dependency graph decoder in accordance with a 

^^Z°^^^^^^ * 8 ^ netWWk dePendenCV 9raPH 

decoder of the type shown in FIG. 7. 

noteiled Description of the Invention 
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uegaiieg w^w. ., ~- ■ 

„ 1lpnhAr nf evemDlarv decoding algorithms and corre- 
t 00251 The present invention will be mustrated here,r '^J^lSJSJ^ of particular embodiments 
Ipond ng decoder architectures. It should be unde ^. 0 °f^ algorithm or corresponding decoder 

oLe,nv 9 ent.on,andthatme = 
architecture which can benefit from the increased inroug v 

coding on a probability dependency graph. e |e and withou , limitation, any 

[0026] The term -general code" as used herein is deri ved or otherwise determined. 

S>de or which an associated parity check ^T^^^dtS'uS by way of example and without limitation, 
[0027] The term "probability dependency ^.^"^exac or approximate probability of a value asso- 
any representation of interconnected nodes ^red such that_ a exac PP abiliUes of one or m0 re values asso- 
c Jedwith a given node can »%^ZZ^^£Z* or approximate probabilities may be exact or 
elated with one or more nodes connected to tne given 

approximate a-posteriori probabilities. Qrr , hr>riimen t s nrovides block-parallel algorithms for decoding a icode 
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r00311 In the decoder 200 of FIG-2,thevanable nodes a re denox«i y j nod9 corresponds to a 

5 SL circles. Each of the nodes in thfc «*^£Z^££* beJ it should be -derstood^- 
comDUtation unltcapableof performing one ormore °" n "^T! Dlenodesare evaluated using the same process- 
evTr Svanableandchecknodesmaybegrou^ 

fng node, e.g., in cases where the throughput re ^^J°^e used to implement multiple nodes of the probab.lrty 
nodes 1" such an arrangement, a single computation ^ £ s ^ e dedicated computafon unrt, o 

o e 4ndencygmph.Agrvenpmcess^ 

T00321 The decoder 200 is initialized by sending ,tc ,eac \f^™°^ m< and ,(.) te a function determined 
eceL value, e.g.. f (ft) where f.'^J^fu ^^1^ ^ exponential function. This InKaHzabon 

, .teach oftbechecknodes, denoted ^"^ffS^ 232 
he vaSle nodes connected to that check node. e ^ «^ or another parameter. The function 

be performed in parallel. calculate a possibly different function h(.) of the input 

2 It each of the variable nodes, denoted t£ VV £i, ««c J rentf unions h(.) may be used at dflerent 

performed in parallel. e received block 

r.0033, A single iteration of this process produces 

Advantageously, each of the calculations of a g ven , nwrton . ™y be ,p thejr corresponding architectures 

sequential intra-block dependencies of «^|^* ^J^^ all check nodes satisfy a constraint of the 
The decoding algorithm in tt»e decoder ^ " *25on results at the variable nodes g.ve the decoded 
code or after a maximum number of iterations, and the of iterations fe generally dependent 

"Ltesofthetr— 

upon the particular implementation, e.g., may c°n^spu 

an available time period in a particular W*™^^ 200 may be constructed utilizing a parity check matnx H 
(00351 The probability dependency graph of the decoder 2 °° m J „ each column ln H, and one check 

Sated wim the corresponding code^th ^J^^^ondsto a connection between a variable no* 
node associated wfth each row in H. Every set etement h m» P g no{j9 „ , ne d ^ de r 

n and a check node m. Hence, the number of edges ,n t h ^aph en 9 ^ ^ grflph ^ or leavln g 

to equal to the number of non-zero entries in J and ^ ^ ^ ^ „ Rqw operations may be 
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□ {0,1. 
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,u HoondPr 200 bv testing whether the current decoded bits x p i 
A test for completion may be performed »n ttje decoder 200 by 
at the variable nodes satisfy the parity check matrix, 

Z ! all c2ck nodes are satisfied by their current inputs. 

cWc,= 0D/D{0,1,.... K-1}, 

100381 Referringto FIG. 4, a given check node 400 .ncludes a one o1 a CO rrespond.ng set of outputs 

ff^»-*"'^SS31l« update the reiiabfitties. in add,t,on to a 
SSch^^ 

f 0 04b] Referringto FIG. 5, an ^^^^^Zi that wfthin each variabie node V„ I*™-'" 
L and a set of subtracters 504-0, 504-1 504-| n Is assum ^ produces a resutt A , The 
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out,=^(A f +in 0 +in. +...+in, -in,) 

E accordance with the invention. The check node 600 °3 fl set ol sub ,ractors 608-1 through 608-fc 
a seTo output function elements 604-0 through 604^ an adder^ 606 an ^ ^ ^ unct 

Th input function elements imp.ement natural logs ^2TEJ«5- °«tputs from each of the input »™*on*H 
laments implement complementary •^^J^'S^Sr^ different between the sum and ft. .«*«- 
Lnts and delivers the resulting sum to each of the »*™« ate tne correspond.ng updated outputs^ 

Son element outputs are applied to ^f^^SSS^ *«* n ° d " ^ 3 maX ''° 9 

[00421 The implementation shown in FIG. 6 can oe w 
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out, = exp(m« (in (in, ))) . 
70o1n accordance with the invention. The deader J^J^JJ^^^ 

BavesiaTnetworkprobabHity dependency graph. The graph mdud esam p^ lncludes further levels of nodes 

fo be decoded. These input nodes are denoted as Leva 0 .n tt» figure^ uent |evel . tos flrr ange- 

such that any node has inputs only from J P^J^SJ ^TeqSL intra-b.ock dependencies. The number o 
me nt aliows calculations to be perfon^d attach JjJJJ^J, ^ nodcs are ae term.ned by the code. The fine. 

M4fl The decoder 700 is initialized by proving as ^nput to e ach node deteimlne d by the code e.g.. 

riM ~d» ood • M °'0"o» "° a 'f l !r^St,u.»e.. > »» oolod M «-» "-» °« 

„ br^^ — - - - « figs 3 - ; 
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Claims 

2 o symbols to be decoded. 

probability dependency graph. 

in parallel. 

^?sssr^i-^==s----- — — — 

calculations are performed in parallel. 

1 „™^„~— -»o— — — «-»•—— 

50 averaging function. 



35 



40 



45 



6. 



7. 



8 



^^^^ 



EP 1 158 682 A2 



20 



25 



nodes satisfy a constraint of the code. 

• *h worw-narallel decoding process Is terminated after a maximum 
14. The apparatus of method of claim 3 wherein the block-parallel decodi g 

number of iterations. 

10 probability dependency graph. 

plurality of levels of nodes including an initial level, ai ieas 
symbol in the given block. 

cies. 

»-r^-~----- , " ,,, *' M " 

" mrtted bits or symbols for the given block. 

/ { ) ' s a function deteintlitecl * least In part by the code. 

o*od el eMn, 22 —* «.. I»e».n f (.) eert, rt~. * M* — - • *— » ■ * 

a • — 

»».^--«--n«------«--'---- , ^ ,,, ' , -""" ,! '"" 

symbol in the given block. 

decoding P.e«=.~ l» din.r.»eod«,. 

. » .PP»«ee e, - - - - — - — * — * «" — """" , "* ' °'" ,V °'""" a ' "* 
" 29. — 1 e,».rt,e»edo,e»» 2 .— ee».e^rt..,.eed. t , S ,d.U.«,«P.rtee. 

convolutional code. 
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a valid codeword. 

. ,rr:.:^:^^-»--— — — — 

ones of the nodes. 
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FIG. 3 
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